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About this guide 



This guide provides information about HP Continuous Access EVA: 

• Basic concepts 

• Array configurations 
« Fabric configurations 

• Solution planning 

Intended audience 

This guide is intended for Information Technology (IT) managers, business managers, and SAN architects 
who are responsible for designing, evaluating, and selecting replication solutions. 

Prerequisites 

Prerequisites for using this product include knowledge of: 

• SAN fabric configurations 

• Disaster planning 

« HP StorageW orks Enterprise Virtual Array (EVA) 

Related documentation 

In addition to this guide, please refer to other documents for this product: 

• H P StorageW orks Continuous Access EVA administrator guide 

• H P StorageW orks Continuous Access EVA overview 

• HP StorageW orks Continuous Access EVA performance estimator user guide 

H P StorageW orks Continuous Access and Data Replication M anager SAN extensions reference guide 

• HP StorageW orks Command View EVA user guide 

■ HP StorageW orks EVA replication compatibility reference 

• HP StorageW orks Enterprise Virtual Array user guide EVA3000 

• HP StorageW orks Enterprise Virtual Array user guide EVA5000 

• HP StorageW orks Replication Solutions M anager installation guide 

• HP StorageW orks Replication Solutions M anager online help and user guide 

• H P StorageW orks SAN design reference guide 
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To find these documents, go to the web sites listed below. 

• Continuous Access— 

http:/ / hl8006.wwwl.hp.com/ products/ storage/ software/ conaccesseva/ index.html 

• Command View EVA— http:/ / hl8006.wwwl.hp.com/ products/ storage/ software/ som/ index.html 

• SAN design and SAN extensions— http:/ / www.hp.com/ go/ SAN DesignG uide 

Document conventions and symbols 



Table 1 Document conventions 



Convention 


Element 


M edium blue text: Figure 1 


Cross-reference links and e-mail addresses 


Medium blue, underlined text 

(http:/ / www.hp.com) 


W eb site addresses 


Bold font 


• Key names 

• Text typed into a GUI element such as into a box 

• GUI elements that are clicked or selected, such as menu and list 
items, buttons, and check boxes 


Italics font 


Text emphasis 


Monospace font 


• File and directory names 

• System output 

• Code 

• Text typed at the command-line 


Monospace, italic font 


• Code variables 

• Command-line variables 


Monospace, bold font 


Emphasis of file and directory names, system output code, and text 
typed atthe command-line 



WARNING! Indicates thatfailure to follow directions could result in bodily harm or death. 



A 



CAUTION: Indicates thatfailure to follow directions could result in damage to eguipment or data. 



T Tz:)f IMPORTANT: Provides clarifying information or specific instructions. 



NOTE: Provides additional information. 
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Ic)'- HP: Provides helpful hints and shortcuts. 



HP technical support 

Telephone numbers for worldwide technical supportare listed on the HP web site: 
http :/ / www.hp.com/ support/ . 

Collect the following information before calling: 

• Technical support registration number (if applicable) 

• Product serial numbers 

• Product model names and numbers 

• Applicable error messages 

• 0 perating system type and revision level 

• Detailed, specific questions 

For continuous quality improvement calls may be recorded or monitored. 

HP strongly recommends that customers sign-up online using the Subscriber's choice web site at 
http:/ / www.hp.com/ go/ e-updates . 

• Subscribing to this service provides you with email updates on the latest product enhancements, newest 
versions of drivers, and firmware documentation updates as well as instant access to numerous other 
product resources. 

After signing-up, you can quickly locate your products by selecting Business supportand then Storage 
under Product Category. 

HP-authorized reseller 

For the name of your nearest HP-authorized reseller: 
« In the United States, call 1-800-345-1518. 

• Elsewhere, visit http:/ / www.hp.com and click ContactHP to find locations and telephone numbers. 

Helpful web sites 

For third-party product information, see the following vendor web sites: 

• http:/ / www.hp.com 

• http:/ / www.hp.com/ go/ storage 

• http:/ / www.hp.com/ support/ 

• http:/ / www.docs.hp.com 



Continuous Access EVA planning guide 9 



10 Aboutthis guide 



HP Continuous Access EVA overview 



HP StorageW orks Continuous Access EVA is the remote replication componentof HP StorageW orks 
Enterprise Virtual Array (EVA) controller software. W hen this component is licensed, the controller copies 
data online, in real time, to a remote array over a a local or extended storage area network (SAN ). 
Properly configured, HP Continuous Access EVA is a disaster-tolerantstorage solution that guarantees data 
integrity if an array or site fails. 

Figure 1 shows a basic configuration with redundant arrays and fabrics. 0 ne array is located at a local 
(or active) site and the other ata remote (or standby) site. In the figure, one fabric is called the black fabric 
and the other is called the gray fabric. Each array can perform primary data processing functions as a 
source, with data replication occurring on the destination array. The replication process can also be 
bidrectional, with some I/O streams moving to the array and other I/O streams moving simultaneously 
from the array. This feature allows the array to be the source for some data groups and the destination for 
others. 
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1 Local active management server 


2 


Local host 


3 Local controller 1 


4 


Local black fabric switch 


5 Local controller 2 


6 


Local gray fabric switch 


7 Local standby management server 


8 


Interswitch link-black fabric 


9 Remote standby management server 1 


10 


Remote host 


11 Remote controller 1 


12 


Remote black fabric switch 


13 Remote controller 2 


14 


Remote gray fabric switch 


15 Remote standby management server 2 


16 


Interswitch link-gray fabric 



Figure 1 Basic HP Continuous Access EVA configuration with redundant servers 
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In Figure 1, the management server represents the server where the EVA management software is 
installed, including HP Sto rag eW orks Command View EVA and HP StorageW orks Replication Solutions 
M anager. HP recommends at least two management servers at each site to avoid a single point of failure. 
If a significant failure occurs at the source array location, redundancy allows data processing to quickly 
resume at the destination array. This process is called failover. W hen the cause of the array failure has 
been resolved, data processing can be moved back to the original source array by performing another 
failover. Also inFigure 1, the host represents any server that is using storage space on the array. It is also a 
server running applications that are not used for EVA management (such as M icrosoft Exchange). 



r2^> NOTE: For more information about HP Continuous Access EVA features, see the HP StorageW orks 
Lfj Continuous Access EVA administrator guide. 
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2 Designing a remote replication solution 



This chapter describes business requirements and how they affect the design of a remote replication 
solution. 

Topics include: 

• Determining business requirements, page 13 

• Determining the threat radius, page 14 

• M easuring distance, page 15 

• Balancing data replication mode and performance, page 18 

• Balancing data replication mode and performance, page 18 

• Optimizing resources, page 21 



Determining business requirements 

Identify the business requirements driving the need for an HP Continuous Access EVA solution. Common 
business requirements to consider are: 

• H igh availability 

• Disaster tolerance 

• Recovery point objective 

• Recovery time objective 

High availability 

The combination of redundant systems, software, and IT processes, with no single point of failure 
(N SPO F), reduces the risk of downtime and ensures high availability. Continuous Access EVA provides 
highly available and reliable access to data. However, it is a storage solution and does not provide highly 
available applications. 

If you require highly available applications, you must include additional servers to provide application 
processing platforms if the primary server fails. For example, you can deploy a cluster of servers at the 
local site, with either a single backup server or a cluster of servers at the remote site. 

Disaster tolerance 

Disaster tolerance is the high-availability technology and services that enable the continued operation of 
critical applications during a site disaster. For example, if two sites are separated by a distance greater 
than the potential size of a disaster, then one site should be able to continue processing after the disaster. 
Continuous Access EVA enables applications to automatically and continuously build two copies of 
application data at separate sites that are far enough apart so that a single event does not destroy both 
sites. 
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r2^> NOTE: HP Continuous Access alone does not provide high availability and disaster tolerance. Both 
L— I requirements are only a part of the business continuity model; you must consider the entire model if you 
are designing a business continuity solution. For more information, go to hp.com/ go/ continuity. 



Recovery point objective 

The recovery point objective (RPO ) is the amount of data that can be lost at the time of the disaster. RPO is 
measured in time and typically ranges from zero to several hours. For example, with a short RPO , new 
data much be flushed frequently from the server cache into storage to prevent loss due to a server crash. A 
shorter RPO increases the need for real-time (synchronous) data replication. 

Recovery time objective 

The recovery time objective (RTO ) is the length of time ittakes to return an application to operation. W ith 
HP Continuous Access EVA, it includes the time to detect the disaster, fail over the storage, and restart the 
application on a new server. RTO is usually measured in minutes or hours, and occasionally, days. A 
shorter RTO increases the need for communications between the application and the storage. 



Determining the threat radius 

The threat radius is the distance from the center of a threat to the outside perimeter of that threat For 
example, half the diameter of a hurricane or typhoon is the threat radius of that storm. The threat radius of 
toxic chemicals is defined by the strength of the wind, with the downwind threat radius much larger than 
the upwind threat radius, producing a more elliptical threat area. 

The threat radius types are: 

• Local— The threat is less than a few kilometers in radius (less than 25 square kilometers or 
15.5 square miles). Local replication has the least effect on performance compared to the other 
options. Examples of local threats include tornados, fires, floods, and power loss. 

• Metropolitan— The threat extends from 25 square kilometers to 5,000 square kilometers 

(3100 square miles) in radius. The performance impactdue to replication beyond metropolitan-sized 
threats is similar in performance cost to running older disk drives— it is slower, but acceptable. 
Examples of metropolitan threats include large chemical incidents, moderate earthquakes, and severe 
storms. 

• Regional— The threat affects a radius of hundreds of kilometers to tens of thousands of kilometers. A 
regional disaster requires the largest separation distance when planning disaster-tolerant solutions. 
Depending on the distances, data replication beyond a regional disaster threat radius affects system 
performance. For example, separation distances greater than 1,000 kilometers increase the cost of the 
link and slow down performance rather than provide disaster tolerance. Fortunately, these distances 
are rarely needed. Examples of regional threats include large floods, hurricanes, and typhoons. 

Some threats may span two or more types, depending on size and severity. If this is a possibility for your 
environment develop your solution based on the larger of the two threats. 
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Figure 2 illustrates the relative relationship between the threat types. 




1 Regional (> 5,000 square km) 

2 M etropolitan (up to 5,000 square km) 

3 Local (< 25 square km) 

Figure 2 Threat radius 

W hen determining the threat radius, identify the threats to the source system, and if they apply to the 
backup system. For example, do not place both sites in the same flood plain because one flood could 
destroy both sites. Similarly, if severe storms tend to travel in a certain direction, then place the second site 
perpendicular to the expected route of travel, and as far apart as needed to prevent one storm from 
affecting both sites. 

Consider any local regulatory requirements that can increase or limit the separation distance. For 
example, certain counties in the United States require both sites to remain within the same 100 -to 
400 -square-kilometer (60- to 250 -squa re-mile) county. This restriction has limited the maximum separation 
distance to less than 30 km (19 miles) in an area prone to earthquakes. Such earthquakes have affected 
buildings several hundred kilometers from the earthquake epicenter. 



M easuring distance 

The effect of distance on replication time does not change the type or scope of a potential disaster. This 
section describes the following topics: 

• Intersite network requirements, page 16 

• Defining latency, page 16 

• Calculating latency, page 17 
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Intersite network requirements 

Table 2 lists the HP Continuous Access EVA intersite network requirements. For more information about 
selecting the appropriate SAN extension, see the HP StorageW orks Continuous Access and Data 
Replication M anager SAN extensions reference guide. 



Table 2 Intersite network requirements 



Component 


Requirement 


Bandwidth 


Dedicated to storage 


M aximum transmission unit (M TU) of the IP network 


1500 bytes 


M aximum latency 


Oneway— 100 milliseconds 
Round trip— 200 milliseconds 


Average packet loss ratio 


Low loss— 0.0012% averaged over 24 hours 
High loss-0.2% averaged over 24 hours, notto 
exceed 0.5% for more than 5 minutes within a 2 
hour window 1 


Latency jitter 2 


N ot to exceed 10 milliseconds over 24 hours 



l. A network that supports a storage interconnect or remote replication cannot have a packet loss ratio 
exceeding an average of 0.01% over 24 hours. 



2. A measure of how stable or predictable the delay is in the network. It is the difference between the 
minimum and maximum values. The greater the jitter, the greater the variance in the delay, lowering the 
predictability of performance. 

Defining latency 

Latency is also called one-way delay, which is the time needed for the bits of a read or write to move from 
one site to another. The speed of light in a vacuum, for example, is approximately 3 x 10 8 meters per 
second or 186,000 miles per second. In fiber optic cables, this slows to about two-thirds of the speed of 
light in a vacuum, or approximately 2 x 10 8 meters per second. Converting the speed of light in fiber from 
meters per second to seconds per meter, the result is 5 nanoseconds per meter, or 5 microseconds per 
kilometer. The maximum Continuous Access EVA separation is limited to a one-way delay of 
100 milliseconds, which is equivalent to a cable distance of 20,000 kilometers (approximately 
12,500 miles), assuming no other delays. Table 3 lists other examples of one-way delays. 



Table 3 Examples of one-way delays 



One-way delay (ms) 


Point-to-point cable distance in km (miles) 


1 


200 (125) 


3 


600 (375) 


9 


1,800 (1,125) 


18 


3,600 (2,250) 


36 


7,200 (4,500) 


60 


12,000 (7,500 
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Table 3 Examples of one-way delays 



One-way delay (ms) 



100 



Point-to-point cable distance in km (miles) 



20,000 (12,500) 



NOTE: The one-way delay measurement for routed networks is longer than the equivalent for 
point-to-point networks, due to additional routing delays and the indirect paths needed to make the 
connection. 



Calculating latency 



Intersite latency is the distance (measured in time) between two sites. To determine intersite latency, use 
one of the following methods: 

• Network latency— Use if an intersite network exists 

• Driving distance— Use if an intersite network does not exist 



2(^)1 "IIP: If you are converting a point-to-point dedicated network to a shared routed network, allow 50% of 



additional latency (using either method). 



N etwork latency 

Ask the network engineers for an estimate of the one-way or roundtrip intersite latency. For example, the 
network engineers report thatthe current point-to-point network has a 24-hour average roundtrip latency 
of 2 milliseconds. If you are deploying HP Continuous Access EVA using a new routed network, use 3 
milliseconds as the initial estimate. 

The Internet protocol ping utility reports roundtrip latency. For example, using the management server, 
"ping" the internet router at the remote site as follows: 

ping f ull-address-of-remote-router -n 3600 -1 2048 

where: 

• n is the number of pings to perform at one per second (3,600 seconds is one hour) 

• l (lowercase letter L) is the size of the data packet (a Fibre Channel frame is 2,048 bytes) 

Driving distance 

To estimate the cable distance between two sites without a network, measure the distance by driving a car 
between the two sites. For point-to-point networks, multiply the driving distance by 1.5. For routed 
networks, multiply the driving distance by 2.25 to accommodate additional delays from network routing. 
M ultiply either sum by five milliseconds to obtain network latency. 

For a more accurate estimate, contact various network vendors and ask about possible routing and delays 
between the two sites in question. If there is a known delay, use it If not use the driving distance along the 
network path, and not the shortest distance between the two points. 
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Comparing the results 

If possible, compare the results of both methods. If the current network latency is more than five times the 
number determined by the driving distance, consider using alternative networks with a lower latency to 
link the two sites. For example, consider two sites for which the actual driving distance is 135 miles (200 
km). Using the routed network calculation, this distance equates to 450 km, or a one-way delay of 2.25 
milliseconds. If the network ping test reports latency that is 10 times greater (22.5 ms), then consider other 
network options that have a lower latency. 

Oversubscription can increase intersite network latency. To check for oversubscription, look for the packet 
loss ratio. The packet loss ratio indicates the need to retransmit data across the intersite link. Each 
retransmission delays the data in the queue behind the current packet which increases the completion 
time for the pending transmissions. HP Continuous Access EVA does not support a packet loss ratio 
greater than 0.2% after the addition of replication traffic. 

Using the network latency results, determine if the 1/ 0 per second (10 PS) and throughput will meet your 
application requirements. If performance does not meet your requirements, you must reconfigure the 
applications and/ or the intersite link between sites (for example, put applications on different links, 
change the intersite link technology, or adjust the distance). For information about calculating 10 PS and 
throughput performance, see the H P StorageW orks Continuous Access EVA performance estimator user 
guide, which is available atthe following web site: 

http://h20000.www2.hp.com/ bizsupport/ TechSupport/ Documentlndex.isp?contentType=SupportM anu 
al&locale=en US&doclndexld=179911&taskld=101&prodTypeld=12169&prodSeriesld=435080 



2q1 TIP: W hen adjusting bandwidth or distance, ensure you are using the peak, notthe average, 
'Y* requirements of the application. 



Balancing data replication mode and performance 

This section defines replication and its effect on performance. Use this information to determine the type of 
replication required for your environment There are two replication modes-asynchronous and 
synchronous. 

Topics include: 

• Replication overview, page 18 

• Asynchronous replication, page 19 

• Synchronous replication, page 19 

• Recommendation, page 20 

Replication overview 

Replication occurs when a host sends write 1/ 0 to the source disk. The controller intercepts the write and 
sends a copy to the destination disk. As partof the replication process, the EVA controller software adds a 
message with a unique sequence number to the replication 1/ 0 . This number is unique within a DR group. 
The destination controller is responsible for verifying the sequence number and requesting any missing 
data before applying the current write. 0 n initialization of the connection between the controller and the 
switch, the controller configures the switch for in-order delivery of all messages. If a problem occurs, such 
as a single message not being delivered, the controller of the source disk resends the missing message to 
ensure in-order delivery of write 1/ 0 . 
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The controller software also: 

• Attempts to balances performance between replication and non-replication disks so that replication 
disks do not occupy all of the controller resources. 

• Examines new writes received while a full copy is in progress and ensures the data is not replicated if 
the block range of a write is within the area that has yet to be copied. 

There are two replication modes: asynchronous and synchronous. You set the replication mode when you 
create a data replication (DR) group. 

Asynchronous replication 

Asynchronous replication occurs as follows (Figure 3): 

1. The server receives data and stores it in the source controller cache. 

2. The source controller returns an I/O completion acknowledgement to the server. 

3. The source controller sends the data to the destination controller cache. 

4. W hen the destination controller receives and stores the data in cache, it returns an acknowledgement 
to the source controller. 

Typically, asynchronous replication is chosen when response time is a priority. 



r'.lQ O "Q-Q-Q- 



□ □ Q-Oj Q 



1 W rite 1/ 0 

3 W rite 1/ 0 

5 Source controller 

7 Destination controller 

Figure 3 Asynchronous replication sequence 



Synchronous replication 
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2 Acknowledgement 
4 Acknowledgement 
6 Host 



Synchronous replication occurs as follows (Figure 4): 

1. The server receives data and stores it in the source controller cache. 

2. The source controller sends the data to the destination controller cache. 

3. W hen the destination controller receives and stores the data, it sends an acknowledgement to the 
source controller. 

4. W hen the source controller receives the acknowledgement from the destination controller, it returns an 
I/O completion acknowledgementto the server. 
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Typically, synchronous replication is chosen when data currency is a priority. 



r 
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1 W rite 1/ 0 

3 Acknowledgement 

5 Source controller 

7 Destination controller 



2 W rite 1/ 0 

4 Acknowledgement 

6 Host 



Figure 4 Synchronous replication sequence 

Recommendation 

HP recommends the use of synchronous replication, whenever possible, for the following reasons: 

• W hether the replication is performed before the write is acknowledged (synchronous), or after the 
write is acknowledged (asynchronous), both modes use the same buffers to move the data to the 
destination array. Therefore, asynchronous replication only improves response time, not performance. 

• Both replication modes are queued at the source array. The queue size is finite and the peak rate at 
which the queue can be emptied is limited by the separation distance, notthe type of replication. Both 
synchronous and asynchronous replication support the same maximum separation distance. 



:9: 



TIP: Typically, the limiting factor in replication performance is the distance between sites, notthe 
bandwidth of the communications link. 



Synchronous replication provides data protection and asynchronous mode offers no additional 
throughput or performance capabilities over synchronous mode. This differs from other solutions in 
which asynchronous replication is required when the separation distance is pasta typical metropolitan 
threat separation. 

Although asynchronous replication can reduce the response time (write completion back to the host), it 
puts each of the outstanding writes at risk if the source array is lost between the time the write is 
acknowledged to the host and it is written at the destination. 

Asynchronous replication does not use the write history log for its buffer. A new asynchronous 
replication request is temporarily changed to a synchronous request when the replication buffer is full. 
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Figure 5 illustrates the performance differences between synchronous and asynchronous replication. The 
vertical axis is the response time (the time ittakes to complete a single 1/ 0 over distance for both types of 
replication). The horizontal axis is the relative 1/ 0 rate for a given separation distance. 0 nly when the 
application 1/ 0 rate is below saturation (the shaded area) will asynchronous replication respond faster 
than synchronous replication. 



i**h 



NOTE: Because actual values depend on the size of the I/O and the intersite distance, only the relative 
relationship between response time and 1/ 0 rate is shown in Figure 5. 




1 Response time 
3 Synchronous 

Figures I/O rate saturation 



2 I/O rate 

4 Asynchronous 



0 ptimizing resources 



This section describes ways you can optimize your resources for replication. Topics include: 

• Bidirectional replication, page 21 

• M ultiple replication relationships, page 22 



Bidirectional replication 



Bidirectional replication means that an array can have both source and destination disks, but the disks 
must belong to separate or unique DR groups. A single virtual disk cannot be both a source and 
destination. For example, you can configure one DR group to replicate data from array A to array B, and 
another DR group to replicate data from array B to array A (Figure 6). This configuration does not affect 
normal operations or your failover policy. Further, bidirectional replication enables you to actively use the 
destination array while providing a disaster-tolerant copy of the source array's data. 



2q1 TIP: W hen performing bidirectional replication, the disk groups on both arrays should be the same size 
/ y v 



and type. 



If your business needs require bidirectional data transfers, determine the effect it will have on the intersite 
links. For example, consider the bandwidth as two unidirectional flows. Then, use the sum of these two 
flows as the maximum amountof bandwidth, and then add the two flows togetherto obtain the worst-case 
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bandwidth requirements in either direction. The worst-case scenario occurs during recovery after failover 
and should be used in delivering intersite bandwidth requirements. 

You can configure bidirectional replication so that hosts at the destination site, while performing 
secondary tasks, are ready to support the source applications if the local site is damaged. In addition, the 
remote site servers can be configured to handle some of the local site application load, if the application 
load is easily divided. Secondary tasks that can be performed by the remote site include backup, report 
generation, and data mining. 

Figure 6 illustrates bidirectional replication. 




1 Array A 
3 Source 
5 Copy 
7 Array B 

Figure 6 Bidirectional replication 



2 Application 1 writes 

4 Destination 

6 Transfer direction 

8 Application 2 writes 



ultiple replication relationships 



O ne array can have a replication relationship with a maximum of two other arrays (Figure 7). There are 
two unique sets of data (one set of data for each relationship) and notthree copies of the same data. For 
example, site A replicates to site B (one unique set of data) and site A replicates to site C (another unique 
set of data). Using either synchronous or asynchronous replication provides similar levels of performance. 

Evidence shows that multiple replication relationships can improve performance when the overall 
performance is limited by distance, and provided there is sufficient link bandwidth and capability in the 
array, FCA, and servers. For more information about performance and other relationship examples, see 
the H P StorageW orks Continuous Access EVA performance estimation user guide. 
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1 Site A 2 Site B 

3 Site C 4 Hosts (one at each site) 

5 M a nagement servers (one ateach site) 6 Switches (one at each site) 

7 Arrays (one at each site) 

Figure 7 0 ne source replicating to two destinations 

It may be possible to increase performance across a link when using four arrays, two at each site. In this 
configuration, the pair of source arrays share the two destination arrays. The sharing of resources 
improves the performance over that of two single replication relationship pairs, each having a dedicated 
destination. See Figure 8 and Figure 9 for comparison. 



r^f NOTE: W hile this solution optimizes performance, it requires careful planning as each link supports 
L_J different DR groups. 
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1 Site A 2 Site B 

3 Site D 4 Site C 

5 Hosts (one at each site) 6 M anagement servers (one at each site) 

7 Switches (one at each site) 8 Arrays (one at each site) 

Figure 8 Four relationships sharing destinations 

In Figure 9, sites A and D have dedicated destinations— sites B and C, respectively. 
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1 Site A 2 Site B 

3 Site D 4 Site C 

5 Hosts (one at each site) 6 M anagement servers (one at each site) 

7 Switches (one at each site) 8 Arrays (one at each site) 

Figure 9 Two relationships with dedicated destinations 
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Although HP Continuous Access EVA supports multiple relationship configurations (Figure 10), HP does 
not test or recommend these types of configurations. 




I Array A 
3 Copy 

5 Source 
7 Array B 

9 Application 2 writes 

II Application 3 writes 



2 Application 1 writes 
4 Destination 
6 Application 6 writes 
8 Application 4 writes 
10 Array C 

12 Application 5 writes 



Figure 10 Multiple replication relationship not recommended by HP 
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Designing a remote replication solution 



3 Planning the array configuration 



This chapter describes how to plan the array configuration for remote replication. Topics include: 

• Data replication groups, page 27 

• Performance considerations, page 27 



Data replication groups 

A data replication (DR) group is a named group of virtual disks selected from one or more disk groups so 
thatthey remotely replicate to the same destination, fail over together, share a log (DR group log), and 
preserver write order within the group. DR groups are created in pairs, consisting of a source DR group 
and a destination DR group. Each DR group may contain one or more virtual disks. For optimal 
performance, however, limit each DR group to one virtual disk. 0 ne DR group supports a maximum of eight 
source-destination pairs from one or more disk groups within the same array. 

Continuous Access EVA supports a maximum of 128 DR groups on each array, with each DR group 
consisting of one virtual disk. If you create DR groups with multiple virtual disks, the maximum decreases. 
For example, if each DR group contains eight virtual disks, the maximum number of DR groups decreases 
to 16. 

It is not necessary to use all 128 DR groups, nor will smaller HP Continuous Access EVA configurations 
need all of them. For example, one application can generate multiple 1/ 0 streams using the full 
bandwidth of the controller and only require five DR groups. Further, the size of a single virtual disk can 
require most of the available capacity within the storage array cabinet DR groups can exist in any 
supported VraidO, Vraidl, or Vra i d 5 format but the source and destination in each DR group must be of 
the same type. 



r^f NOTE: In a Continuous Access EVA configuration, HP recommends thatyou do not use Vraid 0 at any 
Lfj time and only use Vraid 5 on arrays with fewer than eight disks. 



Snapshots and snapclones share some of the virtual disk's resources that are also used for replication. 
Therefore, HP recommends thatyou limitthe number of snapclones created when peak replication 
performance is required. W ith Virtual Controller Software (VCS) version 3.02, you can choose the Vraid 
type for both the snapclone and the snapshot as well as the location of the snapclone. 0 ne DR group 
supports a maximum of eight snapshots or snapclones. 



Performance considerations 

The section describes the performance issues to consider as you plan disk group configuration for 
replication. Topics include: 

• Performance requirements and I/O patterns 

• W rite history logs 

For instructions about configuring disk groups, such as creating disk groups and designing capacity, see 
the H P StorageW orks Command View EVA user guide, which is available at the following web site: 
http:// hl8006.wwwl.hp.com/ products/ storage/ software/ som/ index.html . 
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Performance requirements and I/O patterns 

In HP Continuous Access EVA, performance is not always related to the number of disks available to store 
data. Because of replication to a remote array, there is a point where adding more disks does not increase 
the maximum write rate, only the maximum random read rate. If an application has a high percentage of 
random reads compared to writes, then a large number of disks in the disk group is appropriate. If, 
however, there is a high percentage of writes compared to reads, the actual task of replication limits 
performance rather than a limited number of disks. Additionally, sequential access (read or write) is 
limited by the per-disk performance rather than the number of disks in the disk group. 

Analyze the transfer size of the replication I/O and the distance between the source and destination 
arrays. Based on the results, consider the following performance issues: 

• If the application 1/ 0 stream is dominated by a mix of simultaneous sequential and random transfers, 
determine how these streams can be directed to specific virtual disks. 

Put virtual disks with similar tasks in the same disk group. In general, separate sequential 1/ 0 stream 
data (database logs, rich content) from random 1/ 0 streams (database information store, file shares). 

• N ote that transfer profiles to a given disk that differ over time are not a major consideration. A virtual 
disk that receives sequential transfers for part of the day and random accesses for the rest of the day 
operates well in both cases. The issue is accommodating simultaneous sequential and random streams. 

W rite-to-disk rate 

For currentapplications, determine the 1/ 0 performance rates of each virtual disk replicated to the remote 
site. Calculating the average and maximum write rate (write I/O per second) and peak write transfer rate 
(bytes per second) can require some analysis and time. Use operating system-specific tools, such as 
PERFM ON or 10 STAT, to collect the data. If the data is available only as an average over time, attempt to 
ascertain the peak hours of operation and estimate the peak write rate and write transfer rates. 

Record the peak and average write rates and the write transfer rates. If bidirectional, record these numbers 
for each direction. Compare these numbers with intersite link technologies to determine which technology 
is most cost-effective. If there is not one technology that proves most cost-effective, consider other methods 
of replicating data or replicate only the most critical data, such as transaction or retransmission logs. 

The average load on any link must not exceed 40% of rated capacity, and the peak loading must not 
exceed 45% of rated capacity. This limitation allows 1/ 0 from a failed link or fabric to run on the active 
fabric or link, without causing additional failures of the surviving fabric. 

0 ne final consideration is thatas distance (or intersite latency) increases, the distance limits the maximum 
1/ 0 rate more than the bandwidth. For example, if the calculations used in the previous examples were 
repeated using 100 msec of one-way latency instead of 1msec, regardless of the bandwidth, the math 
shows only five writes per second are possible for a single replication stream. 

W rite history logs 

A DR group uses the write history log when a problem occurs with the intersite links. The write history log 
requires additional space, ranging from 136 M B to 2 TB. The controller places the log in the disk group 
with the most free space. This may be the disk group containing the DR group, or a different group. In 
either case, the space must be included in the disk space planning. Logs are of type Vraidl. 

VCS 3.02 and later allows you to create disk groups using near-online and online disks. N ear-online disks 
are more cost effective for storing the write history logs for all DR groups that exist on an array. VCS 3.02 
and later automatically selects a near-online-based disk group, if one exists when the DR group is created, 
for the write history log. The write history log will not move if additional disk groups are created after the 
DR group is created. 
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Table 4 lists cases that illustrate the process VCS uses to select a disk group for the write history log. 



Table 4 Disk group selection process 



Case 


Action 


The array contains one defined disk group. 


VCS automatically places the write history log in the 
defined disk group. 


The array contains one near-online disk group and more 
than one online disk group. 


VCS automatically places the write history log in the 
near-online disk group. 


The array contains multiple near-online disk groups. 


VCS selects the near-online disk group containing the 
most free space. If more than one near-online disk group 
has the same amountof free space, VCS alternates 
between the members to balance the use of the free 
space. 


The array contains multiple online disk groups and no 
near-online disk groups. 


VCS selects the online disk group containing the most 
free space. If more than one online disk group has the 
same amountof free space, VCS alternates between the 
members to balance the use of free space. 
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4 Planning the fabric configuration 



This chapter describes all supported Continuous Access EVA fabric configurations. Topics include: 

• Basic Continuous Access EVA over fiber, page 31 

• Continuous Access EVA over W DM , page 35 

• Extended Continuous Access EVA over IP configuration (long-distance solution), page 37 

• Continuous Access EVA over SO N ET, page 39 

• Continuous Access EVA over ATM , page 39 

• Continuous Access EVA stretched cluster support page 39 

• Alternate configurations, page 40 

• Advanced configurations, page 43 



Basic Continuous Access EVA over fiber 

Continuous Access EVA over fiber is the most basic H P Continuous Access EVA configurations. As shown 
in Figure 11 on page 32, this configuration supports two redundant fabrics, in which the first FCA in host 
A is connected to switch W , and the second FCA in host A is connected to switch X. The top controller of 
the array on the left is attached to switch W and switch X, and the bottom controller is also attached to 
switch W and switch X. 

At the right side of the figure, the backup host and the array are wired the same way as at the left side. 
Using the same switch ports for the same functions at both sites reduces confusion during a disaster or 
debugging. H P also recommends naming the two fabrics to distinguish them. For example, name them top 
and bottom or black and gray. 

This dual-fabric SAN provides no single point of failure atthe fabric level. For example, broken cables, 
switch updates, or an error in switch zoning can cause one fabric to fail, leaving the other to temporarily 
carry the entire workload. Currently, a maximum of 28 B-series switches, 16 C -series switches, or 24 
M -series switches are supported in each fabric. For additional information, contact your local HP 
representative. N on-Continuous Access EVA servers and storage are allowed on each fabric, if each is 
kept in a zone separate from the Continuous Access EVA solution space. 

Total solutions larger than what is possible with a single supported solution are also supported. Each of 
the smaller solution instances must exist within a single management zone that conforms to all the 
requirements outlined in the section "Configuration rules" on page 34. The combination of two or more 
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solution instances must not exceed the maximum configuration described in the H P StorageW orks SAN 
design reference guide. 




I HostA 
3 Host B 

5 Switch Y 

7 M anagementserver 
9 Controller Bl 

II ISL - gray fabric 
13 Controller Al 

15 M anagement server 
17 M anagementserver 



2 N etwork interconnect 
4 M anagement server 
6 ISL -black fabric 
8 Switch Z 
10 Controller B2 
12 Controller A2 
14 Switch X 
16 Switch W 



Figure 11 Basic Continuous Access over fiber configuration 



Cabling 



Figure 12 on page 33 shows the supported cabling. The basic rule is thatthe first or left-hand port on the 
top controller is cabled to the first fabric, and the other port of the same controller is cabled to the other 
fabric. The other (bottom) controller is cabled so thatthe left-hand port is attached to the second fabric, 
while the second port is cabled to the first fabric; the opposite of the first (top) controller. Even though it 
does not matter which switch ports are used, symmetry is recommended. If there is a fabric failure, the 
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virtual disk stays on the same controller but moves to the other fabric. Any other controller-to-fabric cabling 
scheme is not supported. 
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Figure 12 Supported cabling 

The cabling in Figure 13 is not supported because 
the virtual disk changes controllers if a fabric failur 
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1 This cabling is not supported 2 C ontroller A 

3 Controller B 4 Switch 1 

5 Switch 2 

Figure 13 Example 1 of unsupported cabling 
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The cabling in Figure 14 is not supported because both port Is and port 2s share the same fabric. This 
inhibits static load balancing by DR group and limits failover operations. 
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1 This cabling is not supported 2 Controller A 

3 Controller B 4 Switch 1 

5 Switch 2 

Figure 14 Example 2 of unsupported cabling 

Configuration rules 

The following rules apply to the basic Continuous Access EVA over fiber configuration: 

• At least two, but no more than 16 arrays can be split between the local and remote sites. Each array 
dedicated to an HP Continuous Access EVA configuration must have dual array controllers. 

• The operating system on each host must either implement multipath support (such as 0 penVM S and 
Tru64 UN IX) or support it using H P StorageW orks Secure Path software. 

• The minimum H P StorageW orks Enterprise Virtual Array storage configuration supports a maximum of 
28 disks on each array, with larger configurations supporting up to 240 disks (with an expansion 
cabinet). Destination virtual disks must have the same geometry and capacity as the source virtual 
disks of the source-destination pair. 

• Source and destination disk groups do not require the same geometry (online and near-online) and 
capacity. However, the disk group with fewer disks has a lower peak performance than the one with 
more disks. Disk groups supporting bidirectional replication should be symmetric in both size and disk 
performance for consistent performance from either array. 



ply? NOTE: A disk group should contain only one model of physical disk. 



• Both controllers within an array must have the same version of the Virtual Controller Software (VCS) 
installed and running. The exception to this rule is that when changing the firmware, both arrays must 
have the same version of VCS installed and running. 

• A minimum of two FCAs (or one dual-port FCA) are required for each host to ensure that no single 
point of failure exists between the host and the array. A maximum of four single-port two single-port 
and one dual-port or two dual-port FCAs per host is allowed. 

• A maximum of 256 FCAs per array are allowed. The ports can be a mix of single- and dual-port FCAs. 
At two FCA ports per server, the 256 limit equates to a maximum of 128 servers. 
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• To maintain write order across the members of a DR group and to maintain a fail one/ fail all model, 
all members of the DR group mustbe preferred to the same array controller and use the same FCA port 
pair. In a configuration with multiple pairs of FCAs, all the virtual disks belonging to the same DR 
group are restricted to using only one FCA port per host 

• Each site should have one HP Continuous Access EVA documentation set and one array platform kit 
(appropriate for the array type and server operating system) per implemented operating system 
platform. The reason is to supportdisaster recovery, rebuilding or repair of the surviving system should 
access to the other system or site not be possible. 

• 0 ne G BIC or SFP that is appropriate for the type of fiber optic cable being used is required per switch 
port connection. 

• Each site must have at least one management server. Two management servers are recommended for 
high availability. 

• The designed switch configuration must be supported. See the H P StorageW orks SAN design reference 
guide. 



r2^f NOTE: Use a third-party vendor to acquire and install all SM F optic cables, any M M F optic cables 
c£l longer than 50 m, and W DM interfaces. 



M aximum Continuous Access EVA over fiber 

The maximum Continuous Access EVA over fiber configuration supports up to 16 arrays split between the 
two sites, depending on the SAN topology. High performance SAN s can be built using a skinny tree 
topology as defined in the HP StorageW orks SAN design reference guide. However, using a 
high-performance SAN can reduce the maximum number of hosts and arrays, due to the reduction in open 
switch ports. 

A large port-count SAN can be constructed using multiple instances of smaller configurations, each in a 
separate management zone, subject to the limits in fabric sizes as defined in the HP StorageW orks SAN 
design reference guide. 



NOTE: See Table 6 on page 51 for limits based on separation distance. 



Continuous Access EVA over fiber with long-distance G BICs and 
SFPs 

Basic Continuous Access EVA over multimode fiber supports distances of up to 500 m at 1 G b/ s, and up 
to 300 m at 2 Gbps. 

Longer distances require the use of long-distance and very long-distance G BICs and SFPs. Long-distance 
G BICs and SFPs using single-mode 9-u.m fiber can span distances up to 10 km. Atthe time of this 
publication, very long-distance G BICs and long-distance SPFs running on 9-u.m fiber can suppo rt dista nces 
up to 100 km at 1 G bps, or up to 35 km at 2 G bps. 

B-series switches may require the optional Extended Fabric License for this configuration. 



Continuous Access EVA over W DM 

As an option, Continuous Access EVA over fiber also supports the use of wavelength division multiplexing 
(W DM ) instead of the long-wave or very long-distance G BICs. 
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Figure 15 shows a Continuous Access EVA over W DM configuration. Currently, HP supports HP 
Continuous Access EVA over any vendor's dense wavelength division multiplexing (DW DM ) or coarse 
wavelength division multiplexing (CW DM ) system, if the installation conforms to vendor specifications. 
There will be a performance impact due to distance and/ or limited buffer-to-buffer credits. In addition the 
maximum distance may be limited by the switch vendor. See the HP StorageW orks Continuous Access and 
Data Replication M anager SAN extensions reference guide for more information. 




I Host A 
3 Host B 

5 Switch Y 
7 W DM 
9 Switch Z 

II Controller B2 
13 Controller A2 
15 Switch X 

17 Switch W 



2 N etwork interconnect 
4 M anagement server 
6 ISL- black fabric 
8 M anagement server 
10 Controller Bl 
12 ISL - gray fabric 
14 Controller Al 
16 M anagement server 
18 M anagement server 



Figure 15 Continuous Access EVA over W DM configuration 

The difference between the use of WDM and the basic solution is the replacement of at least one, if not 
both, long-distance G BICs and single-mode fiber with a multiplex unit shortwave G BICs, and multimode 
fiber. For more information on Continuous Access over W DM , see the H P StorageW orks Continuous 
Access and Data Replication M anager SAN extensions reference guide. 
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Configuration rules 

The following rules apply to the H P Continuous Access EVA over W DM configuration: 

• Typically, one switch-to-W DM interface cable is required per wavelength of multimode fiber to connect 
the switch to the W DM unit 

• If you are using older B-series switches, an Extended Fabric License may be recommended. See the HP 
StorageW orks Continuous Access and Data Replication M anager SAN extensions reference guide for 
more information. 



Extended Continuous Access EVA over IP 
configuration (long-distance solution) 

The extended Continuous Access EVA over IP configuration is similar to the basic Continuous Access EVA 
configuration exceptfor the use of Fibre C ha nnel-to -IP gateways. Due to the dual fabrics, two gateways 
are required at each site— one per fabric, for a total of four per solution, dedicated to that solution and 
eliminates single points of failure. 

Continuous Access EVA over IP has the same maximum configuration limits as those described in 
"Configuration rules" on page 34. M ultiple instances can share the same fabric if all components are in 
unique managementzones and the network bandwidth is sufficientfor all traffic flowing between the sites 
in a worst-case scenario. 



r^f NOTE: See Table 6 on page 5 1 for limits based on separation distance. Also, see the H P Sto ra g eW o rks 
Lfj Continuous Access and Data Replication M anager SAN extensions reference guide for information about 
network requirement differences for single ISL and shared or dual ISLs. 



Current versions of the Fibre Channel-to -IP gateways support direct connection to either 10/ 100-M bps 
copper or 1-G bps optical Ethernet The Fibre C ha nnel-to -IP (FC IP) gateway uses the intersite network 
bandwidth that is set aside for the storage interconnect The IP tunnel that is created to support the FC IP 
traffic also provides enhanced security of the data because of the nature of IP tunnels. HP recommends 
designing the IP tunnels with enough bandwidth to carry all the intersite data traffic in case either link 
fails. 

Packet loss within the IP network is tolerated and even expected, due to oversubscription or inadvertent 
congestion. As a result of these errors, a packet can be dropped without the sender being notified thatthe 
packet is now lost However, for every packet that is lost in the intersite network, that same packet must be 
retransmitted by the sender until received at the receiver or until a link timeout occurs. The effect of these 
retransmissions is seen as increased delay on the particular packet and a resulting decrease in the 
available bandwidth because it is not available for new packets. The greater the percentage of packets 
lost in the transfer, the lower the effective bandwidth and the longer a particular transfer will take. For 
example, using a maximum bit error rate (BER) of 1 in 10 10 , one in approximately 500,000 2-KB data 
frames will require retransmission. Atthe other extreme, a 1 percent packet loss translates to losing 1.3 
data frames in 100 2-KB packets, or some part of almost every 64-KB write due to network errors. 

By way of comparison, Fibre C hannel networks are designed for a BER of 1 in 10 12 , or one in 
approximately 50,000,000 2-KB data frames. Because of this, HP recommends that both a maximum 
delay and maximum BER be specified in the network service contract See the H P StorageW orks 
Continuous Access and Data Replication M anager SAN extensions reference guide for current network 
delay and packet loss ratio requirements. 

Some wide area networks can be built using a ring architecture where one way around the ring is 
significantly shorter in time than the other (longer) way around the ring. O ther wide area networks can 
also have two paths of different lengths, a shorter and a longer one. In either case, Continuous Access 
EVA supports these occasional drastic changes in the intersite delay, if the longest delay does not exceed 
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an average of 100 ms. To accomplish this, the EVA storage system firmware periodically tests the intersite 
delay and adjusts the heartbeat rates, message time-outs, and outstanding I/O counts for optimum 
performance of an intersite link, based on the current intersite delay. The latency jitter specification in the 
HP Sto rag eW orks Continuous Access and Data Replication M anager SAN extensions reference guide 
refers to either of the two options in the ring and not the difference in latency of one segment of the ring 
versus the other. 

Figure 16 shows a Continuous Access EVA over IP configuration. 




I Host A 
3 Host B 

5 Switch Y 
7 FC-IPY 
9 IP 

II FC-IP B 

13 ISL-gray fabric 
15 Controller B2 
17 M a nagement server 
19 Controller Al 
21 Switch W 



2 N etwork interconnect 

4 M anagement server 

6 FC-IP A 

8 ISL- black fabric 

10 Switch Z 

12 FC-IP Z 

14 Controller Bl 

16 M anagement server 

18 Controller A2 

20 Switch X 

22 M anagement server 



Figure 16 Continuous Access EVA over IP configuration 

Additional configuration rules 

Consider the following requirements when designing a Continuous Access EVA over IP configuration: 

• Typically, one multimode fiber is required to connect the switch to the FCIP gateway. 

• Some FCIP gateways are supported only on the older B-series switches and require the Remote Switch 
Key (vendor-dependent). 
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A third-party vendor is used to acquire and install all SM F optic cables, any M M F optic cables longer than 
50 m, and the FCIP interface boxes. 

Some IP gateways provide a mechanism to notify the fabric that connectivity to the remote gateway has 
been lost Other gateways require the use of a fabric-based heartbeat to detect loss of the intersite IP 
network connection. Vendors that require the fabric heartbeat require installation of the Remote Switch Key 
license onto those two switches that directly connect to the IP gateway. See the H P StorageW orks 
Continuous Access and Data Replication M anager extensions reference guide for more information. 



r^f NOTE: The Remote Switch Key is available only on the B-series switches. For those gateways requiring the 
L_l Remote Switch Key, and on those switches where the Remote Switch Key is installed, do not enable 
suppression of F-Class frames. Doing so limits the supported size of the Continuous Access EVA over IP 
SAN to one switch per fabric at each site. See the H P StorageW orks Continuous Access and Data 
Replication M anager extensions reference guide for more information. 



NOTE: Regardless of the type of site-to-site transport you use (IP, ATM , SO N ET), the FC-IP gateway 
requires either a 10/ 100 M b/ s copper or a 1 G bE optical interface into the local Ethernet network. The 
conversion from the local Ethernet to the long-distance network is expected to be performed by a 
customer-provided network router or gateway. 



Continuous Access EVA over SO N ET 

The extended Continuous Access EVA over ATM or SO N ET configuration is similar to the Continuous 
Access EVA over IP configuration exceptforthe use of Fibre C ha nnel-to -IP gateways. In Figure 16 on 
page 38 replace references to Fibre Channel to IP (FC-IP) gateways with FC to SO N ET gateways. 



Continuous Access EVA over ATM 

Because no FC to ATM gateways are available at the time of publication, another approach is needed if 
a solution requires ATM as the transport between the two sites. That approach uses the same FC to IP 
gateways described in "Extended Continuous Access EVA over IP configuration (long-distance solution)" 
on page 37, but the IP router is required to provide a blade that interfaces with the ATM network instead 
of the IP network. 



Continuous Access EVA stretched cluster support 

Continuous Access EVA supports stretched M icrosoft C luster Servers (M SCS) running W indows 2000, 
W indows 2003, or W indows N T. In this configuration (Figure 17), half the cluster is at the local site and 
the other half is at the remote site. If the source host fails, M SCS fails over the application to the surviving 
host at the remote site and resumes operations using the local site storage. 

Applications running in a stretched cluster in server failover mode incur a performance penalty because of 
the time it takes to read or write data across the intersite link. This performance penalty is directly 
proportional to the distance between the two sites. During testing, almost no additional effect was 
observed with separation distances up to 100 km. For more information on stretched cluster support see 
the HP ProLiant HA/ F500 website at: 

http:/ / hl8000.wwwl.hp.com/ solutions/ enterprise/ hiqhavailabilitv/ microsoft/ hafSOO/ 
description-eva.html . 
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Figure 17 Continuous Access EVA stretched cluster configuration 



Alternate configurations 

The following configurations are supported primarily to reduce the cost of test configurations, and 
secondarily for production as they do not offer the same level of disaster tolerance and/ or high 
availability as the "Basic Continuous Access EVA over fiber" on page 31. 

Single-fabric configuration 

The single-fabric Continuous Access EVA solution is designed for small, entry-level tests or proof-of-concept 
demonstrations where some distance is needed between each of the two switches in the solution. This 
solution can also be used for producing copies of data needed for data migration or data mining and for 
ongoing production where only a single communications link exists. 
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Fabric zoning can be used to create two logical fabrics out of the one physical fabric. Fabric zoning is 
required to isolate servers as documented in the H P StorageW orks SAN design reference guide. These two 
switches share one intersite link, leaving the remaining ports for hosts, array controllers, and a 
management server. For example, if a 1 6 -port switch is being used, the remaining 15 ports support up to: 

• Four hosts, one array, and one management server 

• Two hosts, two arrays, and one management server 

An example of the single-fabric configuration using 16 -port switches is shown in Figure 18. 

Each of the switches shown in Figure 18 can be replaced with any supported fabric topology as defined 
in the HP StorageW orks SAN design reference guide. The same limits apply— up to 28 B-series, 16 
C-series, or 24 M -series switches are allowed in the single fabric. 

All intersite links supported in the basic Continuous Access EVA are also supported in the single-fabric 
configuration. This means that the ISL can be direct fiber, a single W DM wavelength, or a single Fibre 
Channel over IP link. 




1 Host A 

3 HostX 

5 Switch Y 

7 Controller A 

9 M anagementserver 



2 N etwork interconnect 

4 M anagement server 

6 Controller Y 

8 Switch A 



Figure 18 Single-fabric configuration 

Single-switch configuration 

The single-switch Continuous Access EVA solution is designed for small, single-site, entry-level tests or 
proof-of-concept demonstrations. This non-disaster-tolerant solution can also be used for producing copies 
of data needed for data migration or data mining. Dual FCAs and multipathing software are required. A 
16-port switch can support a maximum of three hosts, two arrays, and one management server. Large 
switches support more servers and/ or storage arrays if all FCA and array ports are connected to the same 
switch. Fabric zoning can be used to create the two logical fabrics used by Continuous Access EVA. Fabric 
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zoning is required to isolate servers as defined in the H P StorageW orks SAN design reference guide. An 
example of the single-switch solution is shown in Figure 19. 
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1 Host A 2 Host B 

3 N etwork interconnect 4 HostX 

5 M a nagement server 6 Controller Y 

7 Controller A 

Figure 19 Single-switch configuration 

In Figure 19, hosts A and B are of one supported operating system and are clustered together using a 
supported cluster technology for that operating system. In this example, host X is a single server running 
the same 0 S as clustered hosts A and B, and therefore is available as a backup to the cluster. As another 
example, host X with a different 0 S can be a standalone server used for training on storage failover. 

The single switch shown in Figure 19 can be replaced with any supported fabric topology as defined in 
the H P StorageW orks SAN design reference guide. The same limits apply— up to 28 B-series, 16 C-series, 
or 24 M -series switches are allowed in a single fabric. 

Single FCA solution 

A host containing a single FCA can be attached to any of the following configurations: 

• Basic Continuous Access EVA, and its optional links 

• Single fabric 

• Single switch 

This option allows the use of servers that only support one FCA due to slot restrictions, at the expense of 
reduced availability due to the single point of failure. To decrease repair time, H P recommends that you 
deploy some standby hosts, each with a single FCA. If supported, each of these active and standby hosts 
should be configured to boot from the SAN , so that any standby host can quickly replace any active host 
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r^f NOTE: Secure Path is required to mask the redundant path except when using HP Tru64 UN IX 
hfi orHPOpenVMS. 



Advanced configurations 

Advanced configurations involve multiple replication relationships, such as: 
« Fan-out replication 

• Fan-in replication 

• Cascaded replication 

These relationships are created between the individual arrays. Each relationship supports one or more DR 
groups not involved in another relationship. Therefore, any one DR group and the source-destination pair 
within it can only belong to one relationship. 

Fan-out replication 

In fan-out replication, one DR group is replicated from array A to array B, and another DR group is 
replicated from array A to array C (Figure 20). 

© 
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1 Array A 

2 Array B 

3 Array C 

Figure 20 Fan-out replication 
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Fan-in replication 

In fan-in replication, one DR group is replicated from array A to array C , and another DR group is 
replicated from array B to array C (Figure 21). 
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1 Array A 

2 Array B 

3 Array C 

Figure 21 Fan-in replication 

Cascaded replication 

In cascaded replication, one DR group is replicated from array A to array B, and another DR group is 
replicated from array B to array C. In this configuration, the source disk for the array B-to-array C 
replication is a snapclone copy of the destination disk in the array A-to-array B replication (Figure 22). 
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1 Array A 

2 Array B 

3 Array C 

Figure 22 Cascaded replication 
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Bidirectional ring replication 



In bidirectional ring replication, three DR groups are replicating clockwise, and another three DR groups 
are replicating counterclockwise. N one of the six DR groups are related, other than the source disk for one 
DR group may be a snapclone of a destination DR group on the same array (Figure 23). 



NOTE: This type of replication is impractical in all but very specialized environments. 



:9; 



1 TIP: In multiple member DR groups, you may need to quiesce the application and flush the server cache 



before creating a snapclone to ensure transaction level data consistency across the members of the DR 
group. 
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I Array A 
3 Copy 

5 Source 
7 Array B 

9 Application 2 writes 

II Application 3 writes 



2 Application 1 writes 
4 Destination 
6 Application 6 writes 
8 Application 4 writes 
10 Array C 

12 Application 5 writes 



Figure 23 Bidirectional ring relationships 
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Planning the fabric configuration 



5 Solution planning 



This chapter describes general design considerations for planning an HP Continuous Access EVA solution. 
Topics include: 

• 0 perating system considerations, page 47 

• Application considerations, page 49 

• General design considerations, page 50 

• Zoning considerations, page 51 

0 perating system considerations 

This section describes the operating systems supported in HP Continuous Access EVA solutions. It also 
describes the operating system capabilities thatare available in an HP Continuous Access EVA 
environment These capabilities are not always available in non-Continuous Access EVA environments. 

Supported operating systems 

Continuous Access EVA supports the following operating systems: 

• HP-UX 

• HPOpenVMS 
HPTru64 UN IX 

• IBM A IX 

• M icrosoft W indows N T, 2000, and 2003 

• N ovell N etware 

• Red Hat Unux 

• Sun Solaris 

• SuSE Unux 

For specific version and server information, see the H P StorageW orks EVA replication compatibility 
reference, which is available from the following web site: 

http:// hl8006.wwwl.hp.com/ products/ storage/ software/ conaccesseva/ index.html 
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0 perating system capabilities 

This section describes two operating system capabilities thatare available in an HP Continuous Access 
EVA solution: boot from SAN and bootless fa ilover. 

Boot from SAN 

An importa nt design consideration is whether to bootservers from the SAN and, if so, whether to replicate 
those bootdisks using Continuous Access EVA. Currently, only HP 0 penVMS, HP-UX Hi, HPTru64 UN IX, 
and all supported W indows operating systems support booting from the EVA-based disks. W ith 
Continuous Access EVA, it is possible to replicate those boot disks to the remote EVA for use in recovery of 
the server and its applications, with the data. The only restriction is that you must place high-performance 
files, such as page and swap files, on storage within the server, rather than on the actual EVA-based boot 
disk. 0 therwise, there is a potentially severe performance impact to the server caused by the replication of 
the writes to these files. 



r^f NOTE: If you replicate a boot disk with a defined IP address, H P recommends that both sites be in the 
L-J same IP subnet so that you do not need to change the address after failing over to the backup copy of the 

system disk. 0 therwise, you must change IP addresses after a server failover, such as during the network 

sta rtup. 



Bootless failover 

Bootless failover allows destination servers to find the new source (after failover of the storage) without 
rebooting the server. This capability also includes the fail back to the original source without rebooting. 



r^f NOTE: For any operating system you use, refer to the OS-specific documentation to ensure that you use 
L-J compatible versions of Secure Path drivers and HBAs. 



Table 5 lists which operating systems support these capabilities. 



Table 5 Supported features by operating system 



Legend: / = supported; X = not supported 


Operating 
system 


Supported 
file systems 


Boot from SAN 
(without clusters) 


Boot from SAN 
(with clusters) 


Bootless 
failover 


HP-UX 


VX and Veritas 3.5 


/ 


X 


X 


HP OpenVMS 




/ 


/ 


/ 


HP Tru64 UN IX 


Advanced, UN IX (UFS) 


/ 


/ 


/ 


IBM A IX 


Journal (JFS) 


X 


X 


X 


All M icrosoft 

W indows versions 1 


NTFS 


/ 


/ 


X 


N ovell N etware 


N ovell Storage 
Services (N SS); 
N etware volumes 


X 


X 


X 


Red Hat Linux 




/ 2 


/ 


/ 3 
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Table 5 Supported features by operating system 



Legend: / = supported; X = not supported 


Operating 
system 


Supported 
file systems 


Boot from SAN 
(without clusters) 


Boot from SAN 
(with clusters) 


Bootless 
failover 


Sun 


UN IX (UFS) 


X 


X 


X 


SuSE Linux 


EXT2, EXT3, Reiser, 
and LVM 


/ 4 


X 


A 6 



1. HP recommends that you apply all patches for security reasons. 

2. Advanced Server v3.0 (32-and 64 -bit) only (with and without clusters) 

3. Supported in configurations using Secure Path; not supported in configurations using Q logic N ative M ultipath 

4. SLES 8 (32-bit and 64-bit) only 

5. Supported in configurations using Secure Path; notsupported in configurations using Q logic N ative M ultipath 

6. SLES 8 (32-bit and 64-bit) and United Unux 1 only 

W indows clusters 

The section describes specific issues identified with M icrosoftW indows clusters. 

Using multi-member DR groups 

There are two restrictions you must follow when using multi-member DR groups with M icrosoft W indows 
clusters: 

• W hen presenting virtual disks to cluster nodes, present all members of a group to the same set of 
FCAs. The group cannot be split across multiple sets of FCAs. For example, if all four FCAs in a host 
need to access an eight-member DR group, then all of the group members can be presented to any two 
FCAs or to all four FCAs. However, the group cannot be split with four members presented to two 
FCAs and the remaining four members presented to the other two FCAs. 

• W hen making UUN assignments, assign each shared virtual disk the same LUN number on every host 
For example, if host A is assigned virtual disk 5 as LUN 3, then host B must also be assigned virtual 
disk 5 as LUN 3. 

Using similar FCAs 

M icrosoft W indows clusters are supported only when all hosts use the same type of FCA. For example, if 
one host is using KG PSA-CA adapters, then any host in the same cluster must also use KG PSA-CA 
adapters. 



Application considerations 

Some applications do not work well in a replication environment Consider the following: 

• W ith a maximum of eight source-destination pairs per application, you must reconfigure some 
applications, such as 0 racle or SAP, to reduce the number of virtual disks to eight Some operating 
systems, such as HP-UX and M icrosoftW indows, have a limited 1/ 0 queue depth and expect to spread 
1/ 0 across many physical disks. Be especially watchful when using a high performance application on 
an operating system platform with limited 1/ 0 queue depth, as there may be a significant performance 
impact if replicating the data. 

• Some applications, such as M icrosoft Exchange, do not tolerate high average 1/ 0 latency and 
therefore may not be suitable for replication beyond a metropolitan area. 
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General design considerations 

This section describes general design considerations for planning an HP Continuous Access EVA solution. 

Failover frequency 

The planned or unplanned failover of one or more DR groups should not be performed more frequently 
than once every 15 minutes. The planned or unplanned failover of a controller should also not be 
performed more frequently than once every 15 minutes. 

Load balancing 

HP Continuous Access EVA is most effective when the average workload (reads and writes) is applied 
equally to both controllers, and therefore, to both fabrics and intersite links. To obtain this balance, ensure 
that the utilization rate of either intersite link stays below 40%. If one link fails, the average utilization of 
the surviving link does not exceed 80%. Similarly, the utilization rate of a single controller on both host 
ports should not exceed 45% (or, at most peak above 50%), to prevent overloading a controller, if one 
fails. 

There are two ways to balance the workload: 

• Let the hosts make the arrangements 

* Prior planning when setting up the replicating virtual disks 

Hosts do not share workload information with each other, therefore, you should plan to use the EVA 
default load balancing tools. 



|i2^> NOTE: HP Continuous Access EVA does not support dynamic load balancing. However, it does support 
L-J static or manual load balancing. 



Understanding management over distance 

Another design consideration is the effect of distance and configuration size on the managementof arrays 
that are not local to the active management server. To estimate configuration size, identify each disk 
group, disk drive, defined server, virtual disk, DR group, and source-destination pair as an object to be 
managed. As the number of objects increases, so does the time it takes to discover the objects and 
manage the array. Similarly, the more remote the array is from the active management server, the more 
time it takes to complete tasks. Combining a configuration with many objects and extreme distances can 
require more time to manage than is acceptable. 

In Table 6, the data is based on a time limit of ten minutes to complete a management action (that is, 
discovery of what is in an array). If you allow more time to discover an array, then you could manage 
more arrays at greater distances. It may take approximately the same amount of time to discover four 
small configurations or two large configurations. However, if the discovery time is five minutes, plan to 
manage fewer arrays for any distance. 
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Table 6 Distance versus array manageability 



Legend: / = supported, recommended; — = not recommended; X = not supported 


Number/ size 
of remote EVAs 


Local 

(< 10 km) 


Metro 
(up to 200 
km/ 1 ms) 1 


Regional 
(1-18 ms) 1 


Multiple regions 
(18-36 ms) 1 


Intra continental 
(36-60 ms) 1 


Intercontinenta 1 
(60-100 ms) 1 


Global 
(>100 
ms) 1 


1 small 2 


/ 


/ 


/ 


/ 


/ 


/ 


X 


1 large 3 


/ 


/ 


/ 


s 


/ 


— 


X 


2 small 2 


/ 


/ 


/ 




/ 




X 


2 large 3 


/ 


/ 


/ 








X 


4 small 2 


/ 


/ 


/ 


y 






X 


4 large 3 


/ 


/ 










X 


8 small 2 


/ 


/ 










X 


8 large 3 


/ 












X 


1 These are one-way latencies. 

2 A small array configuration consists of 1 server using 3 DR groups and 2 copy sets per DR group, for 6 virtual disks built out of 60 
disk drives in one disk group. 

3 A large array configuration consists of 10 servers using 64 DR groups and 64 copy sets, for 64 virtual disks built out of one disk 
group of 24 disks. 



Zoning considerations 

Use zoning when combining different hardware platforms, operating systems, or storage systems that are 
currently supported only in homogeneous SAN s, and it is unknown whether there are interaction 
problems. Table 7 shows the zone compatibility for different platforms in a Continuous Access EVA SAN . 
Platforms in the same column can exist in the same SAN . 

Table 7 Continuous Access EVA Platform Zoning Requirements 



Zone 1 


Zone 2 


Zone 3 


Zone 4 


Zone 5 


HP OpenVMS 


HP OpenVMS 


Linux 


HP-UX 


IBM AIX 


HPTru64 UNIX 


HPTru64 UNIX 








M icrosoft W indows 
NT/ 2000/ 2003 


M icrosoft 
W indows 
NT/ 2000/ 2003 








N ovell N etWare 


Sun Solaris 
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Controller-to-switch connections 

W hen designing your zones, consider that the controllers are to be cabled as follows. 

Four fiber optic cable connections are required for each storage array. The only supported connection 
scheme is shown in Figure 24. Connect the fiber optic cable such that port 1 of Controller A and 
Controller B go to different fabrics. Connect port 2 of Controller A and Controller B to separate fabrics that 
are the fabric opposite from portl on that controller. 

The following naming conventions apply to cabling: 

• The storage system W W N ends with a 0. 

• The Controller A, port 1 is the storage system W W N but ending with a 9. 

• The Controller A, po rt 2 is the storage system W W N but ending with an 8. 

• The Controller B, port 1 is the storage system W W N but ending with a D. 

• The Controller B, port 2 is the storage system W W N but ending with a C . 

A correctly cabled pair of controllers will have all ports 9 & C on one fabric and all ports 8 & D on the 
other. This is useful in planning the zoning of the solution. 




1 B(2) 

3 Switch 1 

5 A(2) 

7 Controller B 



2 A(l) 

4 Switch 2 

6 B(l) 

8 Controller A 



Figure 24 Controller-to-switch cabling 



EVA zoning recommendations 

HP recommends that you zone the switches using the host W W N address for each fabric instead of the 
controller host port W W N . For example, the storage system host W W N is designated as 
50:00:lf:el:00:15:40:80. Cabled to this fabric are Controller A, port 2 (50:00:lf:el:00:15:40:88) 
and Controller B, port 1 (50:00:lf:el:00:15:40:8d). In Figure 25, the storage system hostW W N is 
highlighted and the Add Host > button is used to place this storage system into the fabric. 
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NOTE: This example uses B-series switches. 



0 n the other fabric, the storage system W W N would display as 50:00:lf:el:00:15:40:80, with 
Controller A, portl shown as 50:00:lf:el:00:15:40:89 and Controller B, port 2 shown as 
50 :00:lf:el :00:15:40:8c. The storage system W W N is highlighted, and the Add Host > button is used 
to zone by the host W W N . 

See the H P StorageW orks SAN design reference guide for specific EVA zoning recommendations with 
B-series, C -series, and M -series switches. 
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Figure 25 Example of host zoning with infrastructure switches 
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G lossary 



active management 
server 

array 

asynchronous 



bandwidth 

bandwidth latency 
product 

bidirectional 



B-series switches 

HP Continuous 
Access EVA 



C-series switches 
data migration 
data mining 

data movement 
default disk group 

destination 



disaster tolerance 
(DT) 



disk group 
DR group 



See management server. 



See virtual array and storage system. 

A descriptive term for computing models that eliminate timing dependencies between 
sequential processes. In asynchronous replication, the array controller acknowledges that data 
has been written atthe source before the data is copied atthe destination. Asynchronous 
replication is an optional DR group property. See also synchronous. 

The transmission capacity of a link or system, usually measured in bits per second. 

The measurement of the ability to buffer data and is the raw transfer speed in bytes/ sec x the 
round-trip latency in seconds. 

A descriptive term for an array that contains both source and destination virtual disks. This 
configuration allows multidirectional 1/ 0 flow among several arrays. 

Fibre Channel core and SAN switches made by Brocade and sold by HP. 

H P Continuous Access EVA is is a storage-based H P StorageW orks solution consisting of two 
or more storage systems performing disk-to-disk replication, along with management user 
interfaces that facilitate configuring, monitoring, and maintaining the replicating capabilities of 
the storage systems. 

Fibre Channel switches made by Cisco and sold by HP. 

M oving data to a new location or to a logical disk with a different capacity. 

A process that makes data available so that undiscovered and useful information can be 
extracted, analyzed, or tested. 

Activities such as data backup, data migration, and data distribution. 

The disk group that is created when an array is initialized. The minimum number of disks the 
group can contain is eight The maximum is the number of installed disks. 

The targeted recipient (for example, a DR group, array, virtual disk) of replicated data. See also 
source. 

The capability for rapid recovery of user data from a remote location when a significant event 
or disaster occurs at the local computing site. It is a special combination of high-availability 
technology and services thatcan continue the operation of critical applications in the eventof a 
site disaster. DT systems are designed to allow applications to continue operating during the 
disaster recovery period. 

A named group of disks selected from all available disks in an array. 0 ne or more virtual disks 
can be created from a disk group. 

Data replication group. A named group of virtual disks selected from one or more disk groups 
so thatthey replicate to the same destination, fail over together, and preserve write order within 
the group. 
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dual fabric 
enabled host 
EVA 

event 



fabric 
failover 

failsafe 



general purpose 
server 



home 
host 

initialization 

managed set 
management server 



merge 

M -series switches 
near-online storage 



Two independent fabrics providing multipath connections between Fibre Channel end devices. 
A host that is equipped with a replication host agent 

Enterprise Virtual Array, an HP StorageW orks product that consists of one or more virtual 
arrays. See also virtual arrays. 

• A system-generated status message, resulting from a: 

• -User-initiated action (for example, "suspend DR group") 

-Replication or system transaction (for example, "retrieved data for storage system") 

• -Job operation (for example, "job complete") 

A network of Fibre C hannel switches or hubs and other devices. 

An operation that reverses replication direction so thatthe destination becomes the source and 
the source becomes the destination. Failovers can be planned or unplanned and can occur 
between DR groups, managed sets, fabrics or paths, and array controllers. 

A descriptive term for devices that automatically assume a safe condition after a malfunction. 
Failsafe DR groups stop accepting host input and stop logging write history if a member of the 
group becomes unreachable. 

A server that runs customer applications such as file and print services. HP StorageW orks 
Command View EVA and HP StorageW orks Replication Solutions M anager can be used on a 
general purpose server in limited configurations. 

The DR group that is the preferred source in a replication relationship. By default home is the 
original source, but it can be set to the destination DR group. 

A computer that runs user applications and uses (or potentially uses) one or more virtual disks 
that are created and presented by the array controller. 

A configuration step that binds the controllers together and establishes preliminary data 
structures on the array. Initialization also sets up the first disk group, called the default disk 
group, and makes the array ready for use. 

Selected resources grouped together for convenient management For example, you can create 
a managed set to manage all DR groups whose sources reside in the same rack. 

A server where H P StorageW orks Enterprise Virtual Array (EVA) management software is 
installed, including H P StorageW orks Command View EVA and H P StorageW orks Replication 
Solutions M anager, if used. A dedicated management server runs EVA management software 
exclusively. 0 ther management servers are general purpose servers, H P ProLiant Storage Server 
(N AS) models, and the H P 0 penView Storage M a nagement Appliance. W hen there are 
multiple management servers in a SAN , one is active and all others are standby. The active 
management server actively manages the array, while the standby management server takes 
control of the array if there is a failure on the active management server. There is only one 
active management server at a time for any given management zone in a SAN . 

The act of transferring log contents to the destination virtual disk to synchronize the source and 
destination. 

Fibre Channel Director and Edge switches made by M cDATA and sold by HP. 

0 n-site storage of data on media that takes only slightly longer to access than online storage 
kept on high-speed disk drives. 



normalization 



The initial full copy that occurs between source and destination virtual disks. 
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online storage An allotment of storage space that is available for immediate use, such as a peripheral device 
that is turned on and connected to a server. 



(to) present The array controller act of making a virtual disk accessible to a host computer, 

remote copy A replica virtual disk on the destination array. 

SAN Storage area network, a network of storage devices and the initiators that store and retrieve 

information on those devices, including the communication infrastructure. 

snapclone A copy that begins as a fully allocated snapshot and becomes an independent virtual disk. 

Applies only to the HP StorageW orks EVA. 

snapshot A nearly instantaneous copy of the contents of a virtual disk created without interruption of 

operations on the source virtual disk. Snapshots are typically used for short-term tasks such as 
backups. 

source (home) A descriptive term for the virtual disk, DR group, or virtual array where an original 1/ 0 is stored 
before replication. See also destination. 

See management server. 



standby 
management server 

Storage 

Management 

Appliance 

storage system 



synchronous 



VCS 



virtual array 



virtual disk 



Vraid 



VraidO 



HP 0 penView Storage M anagement Appliance, an HP hardware-software productdesigned to 
run SAN management applications such as HP StorageW orks Command View EVA and HP 
StorageW orks Replication Solutions M anager. 

Synonymous with virtual array. The HP StorageW orks Enterprise Virtual Array consists of one or 
more storage systems. See also virtual array. 

A descriptive term for computing models that perform tasks in chronological order without 
interruption. In synchronous replication, the source waits for data to be copied at the 
destination before acknowledging that it has been written atthe source. See also 
asynchronous. 

Virtual Controller Software. The software in the HP StorageW orks Enterprise Virtual Array 
controller. Controller software manages all aspects of array operation, including 
communication with HP StorageW orks Command View EVA. 

Synonymous with disk array and storage system, a group of disks in one or more disk 
enclosures combined with control software that presents disk storage capacity as one or more 
virtual disks. See also virtual disk. 

Variable disk capacity that is defined and managed by the array controller and presentable to 
hosts as a disk. 

Techniques for configuring virtual disks to provide fault tolerance and increase performance. 
Vraid techniques are identified by level numbers. 



Level 
VraidO 
Vraidl 
Vraid5 



Redundancy 
N one 
High 
M edium 



Technique 
Striping 
M irroring 

Striping and parity 



A virtualization technique that provides no data protection. Data chunks are distributed across 
the disk group from which the virtual disk is created. Reading and writing to a VraidO virtual 
disk is very fast and uses available storage to the fullest but provides no data protection 
(redundancy) unless there is parity. 
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Vraidl A virilization technique that provides the highest level of data protection. All data blocks are 

mirrored, or written twice, on separate disks. For read requests, the block can be read from 
either disk, which can increase performance. M irroring requires the most storage space 
because twice the storage capacity must be allocated for a given amount of data. 

Vraid5 A virtualization technique that uses parity striping to provide moderate data protection. For a 

striped virtual disk, data is broken into chunks and distributed across the disk group. If the 
striped virtual disk has parity, another chunk (a parity chunk) is calculated from the data chunks 
and written to the disks. If a data chunk becomes corrupted, the data can be reconstructed from 
the parity chunk and the remaining data chunks. 

wavelength division The ability to have multiple optical signals share a single optical cable, 
multiplexing (WDM) 
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